arXiv:1502.06871vl [cs.IT] 24 Feb 2015 


On the Multiple Threshold Decoding of LDPC 

codes over GF(q) 

Alexey Frolov and Victor Zyablov 
Inst, for Information Transmission Problems 
Russian Academy of Sciences 
Moscow, Russia 

Email: {alexey.frolov, zyablov}@iitp.ru 


Abstract —We consider the decoding of LDPC codes over 
GF{q) with the low-complexity majority algorithm from (1). 
A modification of this algorithm with multiple thresholds is 
suggested. A lower estimate on the decoding radius realized by 
the new algorithm is derived. The estimate is shown to be better 
than the estimate for a single threshold majority decoder. At the 
same time the transition to multiple thresholds does not affect 
the order of complexity. 

I. Introduction 

In this paper we consider the decoding of LDPC codes Q, 
El over Fg with the low-complexity majority algorithm from 
m. In in Theorem 1] a lower estimate on the relative decoding 
radius p realized by the low-complexity majority algorithm 
is derived. Let us describe the result in more detail. Let N 
denote the code length. In HI it is proved that there exist 
LDPC codes overFg (with probability : limAr_^pAr ^ 1) 
capable of correcting any error vector of weighlj W < pN 
with the decoding complexity 0{N\ogN). We hrst improve 
the estimate on p. 

Then we consider multiple threshold decoding of LDPC 
codes over F,. Multiple threshold majority decoding for binary 
LDPC codes was hrst introduced in Q. In Q it was shown 
that ttansition to multiple thresholds increases the decoding 
radius of the majority algorithm (in the binary case the 
algorithm is usually called bit-hipping algorithm 0, 0) 
without affecting the order of complexity. In this paper we 
generalize the ideas of I?) to the case of non-binary LDPC 
codes. 

Our contribution is as follows. We hrst improve the estimate 
on the relative decoding radius p for the single threshold 
case. Then we suggest the majority decoding algorithm with 
multiple thresholds for LDPC codes over F,. A lower estimate 
on the decoding radius realized by the new algorithm is 
derived. The estimate is shown to be at least 1.21 times better 
than the estimate for a single threshold majority decoder. At 
the same time analogously the result from ID the transition to 
multiple thresholds does not affect the order of complexity. 

IT Preliminaries 

Let us consider the construction of LDPC code C over F^. 
To construct such a code we use a bipartite graph, which is 

'Here and in what follows by weight we mean the Hamming weight, i.e. 
a number of non-zero elements in a vector. 


called the Tanner graph El (see Fig. [T]). The graph consists 
of N variable nodes vi,V 2 ,---,vn and M check nodes 
Cl, C 2 ,..., Cm- We assume all the check nodes to have the 
same degree no and all the variable nodes to have the same 
degree i. Such Tanner graphs are called regular ones. We 
associate constituent codes to each of the check nodes. All the 
constituent codes are the same (we denote the constituent code 
by Co). We assume Co to be a linear [no, Ro, do]-code over F^. 
Let us denote the parity-check matrix of the constituent codes 
by Ho. The matrix has size toq xno, where toq = (1 —i?o)n.o. 


Ho Ho Ho Ho 
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Fig. 1. Tanner graph 

To check if r = (ri, r 2 ,..., r^) G F^ is a codeword of 
C we associate the symbols of r to the variable nodes {vi = 
Ti, i = 1,..., N). The word r is called a codeword of C if all 
the constituent codes are satisfied (the symbols which come to 
the codes via the edges of the Tanner graph form codewords 
of the constituent codes). 

It is clear the resulting code C is linear, so it has a parity- 
check matrix associated to it. We denote the matrix by H. The 
code is over F,j and has the length N. The following inequality 
follows for the rate of the code C 

R{C) > l-l{l-Ro). 


In what follows for the simplicity we consider only the case 
when the constituent code is an [no, no — 1] single parity- 
check (SPC) code over Fg. The generalization to the case of a 
stronger constituent code is simple. It will be briefly explained 
in Remark |4] 






As usually we calculate the syndrome of the sequence r = 
(ri, r 2 ,..., tn) € to be decoded as follows 

S = Hr^. 

In |[T] Theorem 2] it is proved that there exist LDPC codes 
over F„ (with probability : 1™ Pn 1) such that the 

N—^OO 

following inequality holds for the syndrome weight 

W£ 

\S\>L{W) = — (1) 

for all error vectors of weight W < W*{R,£) = uj*{R,£)N. 

To prove Theorem 2 in III a Gallager-like ensemble of 
LDPC codes was used. The only difference to the binary case 
was in multiplication of the parity-check matrix columns by 
non-zero elements from Fg. In what follows we do not need 
the ensemble, so we omit the definition of the ensemble here. 
In what follows we need just an LDPC code over Fg which 
satisfies the property IB- We denote the code by C*. 

We note, that at the same time the following trivial upper 
bound on the syndrome weight holds 

|s| < u{w) = we. 

HI. Single threshold majority decoding 

ALGORITHM 

Let us describe a single-threshold majority decoding algo¬ 
rithm from HI- See Algorithm |III] for full description, here we 
give some comments and explanations. The algorithm is an 
iterative hard decision decoding algorithm. On each iteration 
the algorithm checks all the symbols from the sequence to be 
decoded (r = (ri, r 2 ,..., r^)). For each of the symbols the 
replacement criterion (see below) is checked. If the symbol 
satisfies the criterion, then its value is replaced with a new 
value, syndrome is updated and the algorithm continues with 
the next symbol. 

Remark 1: It is important to note, that the algorithm works 
with the symbols consequently. This means, that in case of 
replacement all the changes are introduced to the sequence to 
be decoded and to the syndrome and then the algorithm goes 
to the next symbol. 

Now let us consider the replacement criterion. Assume the 
algorithm is considering the symbol The corresponding 
variable node Vi is connected to £ constituent codes. Each 
of these codes sends a message to Vi calculated based on 
values of another variable nodes connected to it (usual message 
passing rule). So we have £ messages coming to Vi. Let 
denote a subset of equal non-zero messages of maximal cardi¬ 
nality, let a = |A„iax| r; be a value of the messages from 
Amax- Let a threshold 9 be an integer such that 0 < 6 < £. 
At last let z be a number of zero messages. The replacement 
criterion is as follows. If a — z > 0 we replace the symbol 
with V. 

Remark 2: Note, that within the section 0 = 0, we intro¬ 
duced the parameter here just for our convenience. We will 
use it in the next section. 


And the last thing we have not mention yet is a stopping 
criterion. We stop the algorithm if no changes in r were made 
during the iteration. 

Algorithm 1 Single threshold majority decoding algorithm 
Input: received sequence r, threshold 0 : 0 < 0 < £ 
Output: decoded sequence c, failure flag F 

Initialization: S ^ Hr^; b ^ 1 
while 6 = 1 do 

b^O 

for all 1 < i < do 

calculate £ messages for ri 

Amax ^ maximal subset of equal non-zero mes¬ 
sages 

a I Amax I; V ^ value from A^ax 

z ■«— number of zero messages 

if a — z > 0 then 

Ti V 

update S 
b ^ 1 

end if 
end for 
end while 

F ^ 1 
c ^ r 

if |S| = 0 then 
F ^ 0 
end if 


Lemma 1 (U\ Theorem 3]): Let 


then there exist a symbol whose replacement leads to the 
syndrome weight reduction (at least by 1). 

Proof: A more general proof will be given in the next 
section. ■ 

Theorem 1 Theorem 4]): Let C* be an LDPC code 
over Fq, satisfying ([T])- If the number of errors in the received 
sequence 

W < W*/2, 

the Algorithm 1 (with 0 = 0) will correct all the errors with 
the complexity O(NlogN). 

Here we refine the result of the previous theorem 
Theorem 2 (Single threshold): Let C* be an LDPC code 
over Fq, satisfying ([T]i- If the number of errors in the received 
sequence 

the Algorithm 1 (with 0 = 0) will correct all the errors with 
the complexity 0{N log N). 

Proof: To prove the theorem we need to prove that the 
number of errors at each step of the algorithm is less or equal 
to W* (see condition ([B and Lemma [B- 

Any error vector can mapped to a point of the following 
coordinate system; “syndrome weight - number of errors” (see 






Fig. EJ. At the same time it is clear, that each point in the 
coordinate system corresponds to multiple error vectors. First, 
let us add the lines L{W) and U(W) to Fig. |2] Recall, that the 
syndrome weight of any error vector with W < W* satisfies 
the inequality 

L{W) < |S| < UiW). 



Let us consider the decoding process. It corresponds to some 
trajectory in the coordinate system. We start from the initial 
error vector. With each replacement the syndrome weight 
decreases (we move down at least by 1) and the number of 
errors increases (we can introduce errors) or decreases by 1 
(so we move right or left by 1). The decoding is successful if 
we finish at the origin. 

The area of correctable error vectors is filled by gray color 
in Fig. El Let us explain this fact. Assume we start from the 
point C (see Fig. E) and only introduce errors. In this situation 
we move right and down by 1 with each step (move along 
the line CB). We can not come to the point B as it lies on 
the (strict) lower bound L{W) so it is clear that the number 
of errors can not become greater than W*. In this case the 
decoding (and the trajectory) finishes at origin. To finish the 
proof we just need to calculate the coordinate of intersection 
of two lines; U{W) and CB (starts in W* and has a slope 
equal to —1). The previous estimate (W*/2, point A) is also 
shown in Fig. El 

The proof of the complexity estimate coincides with the 
proof from III. We omit it here. ■ 

Corollary 1: Let us introduce a notation 


= 


i + 2 
2{£+l) 


and consider the asymptotic (N oo) estimate of the relative 


decoding radius realized by Algorithm 1. We have 


piS) > ^ ^( 5 )^* 


N 


In the next section we will increase the estimate by means 
of transition to multiple decoding thresholds. 


IV. Decoding with multiple thresholds 

Let us first introduce the sequence of integer thresholds (let 

t > 1 ) 

Q = 01 < 62 < ■. ■ <0t < i. 


Now we are ready to describe the multiple threshold decod¬ 
ing algorithm. The idea of the new algorithm is in consequent 
applying the Algorithm 1 with different replacement thresholds 
to the sequence to be decoded. We start from the largest 
threshold 6t and end with 0i = 0. Please see Algorithm 2 
full description below for more details. 


Algorithm 2 Multiple threshold majority decoding algorithm 
Input: received sequence r, t thresholds 0 = < 02 < 

... <0t<£ 

Output: decoded sequence c, failure flag F 
Initialization: S ^ Hr^ 
for all 0 < i < f — 1 do 

Apply Algorithm 1 with 9 = 9t-i 
r ^ output of Algorithm 1 
end for 
F <- 1 
c ^ r 

if |S| = 0 then 

F 

end if 


Remark 3: We note, that the implementation of the Algo¬ 
rithm 2 is not optimal. It is much better to implement it in 
such a way. First calculate the syndrome, then sort all the 
symbols in a descending order of a — z value (see previous 
section), then change the symbols consequently and update the 
sorted list. But nevertheless we see here that the complexity 
of Algorithm 2 is no more than t times the complexity of 
Algorithm 1. So the order of complexity is 0{N log N). 

To estimate the decoding radius of the Algorithm 2 we need 
the following Lemma. 

Lemma 2: Let 0 be an integer, 0 < 0 < f, let 
|S| >P(0,1V) = 1V^ 

then there exist a symbol whose replacement leads to the 
syndrome weight reduction by at least by 0-1-1. 

Proof: Consider a subgraph of the Tanner graph that 
contains only erroneous symbols (the number of errors is 
equal to W) and constituent codes connected to these symbols. 
Within the proof we work with this subgraph only. 

Let us introduce the following notation; 

• A is the set of codes that detect an error (|A| = |S|); 














• Ai, i = 1,..., no, is the subset of A containing only the 
codes with precisely i incoming edges (oi = \Ai\y, 

m A >2 = is a subset of A containing only the codes 

with at least 2 incoming edges (a >2 = |^> 2 |); 

• C is the set of codes that contain errors but do not detect 
them (c = IC'D; 

• is the number of edges outgoing from a symbol i 

and incoming to Ai; 

(i) 

• is the number of edges outgoing from a symbol i and 
incoming to C. 



V, V,. 

Fig. 3. A subgraph of Tanner graph 


In Fig. [3] we present an example of a subgraph of the Tanner 
graph and illustrate the introduced notation. 

First note, that if the condition 


holds for the i-th symbol, then the replacement of it will lead 
to the syndrome weight reduction by at least by 0 + 1. To 
prove this it is sufficient to mention that the codes with the 
only error will give equal messages. 

Then we claim that if 

w 

Oi > ^ +Wd, 

i=l 

then there exist a symbol i such that + 9. 

And to finish the proof we need to count the edges in the 
subgraph. The number of edges outgoing from W erroneous 
symbols is Wi. These edges can come to either codes that 
have detected an error (A — AiU A> 2 ) or to codes that have 
not detected errors but contain them (C). Let us estimate the 
number of edges incoming to each of the three sets of codes: 

• The number of edges leading to codes of the set Ai is 

E (l) 

eVi = ai; 

i—1 

m The number of edges leading to codes of the set A >2 is 
at least 2(|S| — oi) (here we use the fact every code has 
at least two incoming edges); 

• The number of edges leading to codes of the set C is 

w ... 

i=l 

Thus 

w 

W£>ai+ 2(|S| -ai) + Y^ 

i=l 


After some transformations, we have 
w 


ai 


>2|S|-ILL 


i=l 


This immediately implies that if the condition of the Lemma 
holds then 

w 

oi > ^ + W9. 


i=l 


Theorem 3 (Multiple thresholds): Let C* be an LDPC code 
over Fq, satisfying dTJ. Let 0 = 0i < 02 < ■ • ■ < < -^ be a 

sequence of thresholds. If the number of errors in the received 
sequence 

W < Wt+i, 


where 


W- = W- 1 -^ 2 JY* 0 ^ I 

* '^'^*-V + 20 ,_ i + 0 , + 2 ’ ' .<^*+1 L 


the Algorithm 2 will correct all the errors with complexity 
0{N\o'gN). 

Proof: The area of correctable error vectors is shown in 
Fig. m For now the area is more difficult because the slope 
at threshold 0^ is equal to 0^ + 1. To prove the Theorem we 
need to consequently calculate coordinates of intersection of 
the area bound and lines P(9i,W). 



Fig. 4. Multiple thresholds 


The most interesting case for us is the case when we have 
all the thresholds from 0 to £ — 1. In this case 


i-i 


w^^'> = n 


i=0 


£ + 3i + 2 
£ + 3i + 3 ' 


W*. 


Let us introduce a notation 


^-1 

fM) ^ Y[ 


i=0 


£ + 3i + 2 
£ + 3i + 3 




















TABLE I 

Results for g = 16 


TABLE II 

Results for g = 64 


R -, i 

a;* 


pCU 

0.125; 45 

0.0103 

0.0053 

0.0065 

0.25; 43 

0.0095 

0.0049 

0.0060 

0.375; 40 

0.0085 

0.0044 

0.0054 

0.5; 31 

0.0072 

0.0037 

0.0046 

0.625; 24 

0.0053 

0.0028 

0.0034 

0.75; 24 

0.0033 

0.0017 

0.0021 

0.875; 26 

0.0015 

0.0008 

0.0010 


R\ i 

a;* 


pCL 

0.125; 21 

0.0156 

0.0082 

0.0099 

0.25; 24 

0.0131 

0.0068 

0.0083 

0.375; 20 

0.0104 

0.0054 

0.0066 

0.5; 22 

0.0081 

0.0042 

0.0052 

0.625; 27 

0.0059 

0.0031 

0.0038 

0.75; 24 

0.0037 

0.0019 

0.0024 

0.875; 26 

0.0017 

0.0009 

0.0011 


and consider the asymptotic (N oo) estimate of the relative 
decoding radius realized by Algorithm 2 (when we have all 
the thresholds). We have 


piM) > 


M4(M) 

N 




In Fig. |5]the comparison of and is shown. 


We note, that the value of > 1.21 for all the 

rates we considered. So transition to multiple thresholds leads 
to the gain in the decoding radius without affecting the order of 
complexity. To the best knowledge of the authors the obtained 
estimates are currently the best estimates of the decoding 
radius for low-complexity majority decoder of LDPC codes 
over Fq. 



Fig. 5. The dependency of and on t. 


At last let us calculate the value of when £ is big. It 
is easy to check, that 

lim = 2-2/3 = 0.6300... 

Remark 4 (Generalized LDPC codes): Here we briefly 
consider the case of generalized LDPC codes, i.e. the case 
when the constituent codes are not SPC codes but some more 
powerful codes. All our theorems work in this case if we use 
the so-called generalized syndrome rather then an ordinary 
syndrome. Generalized syndrome consists of syndromes of 
constituent codes. The weight of generalized syndrome is just 
the number of unsatisfied constituent codes. We would like to 
point out, that analogously to HI the transition to generalized 
LDPC codes does not lead to a gain in the decoding radius. 

V. Numerical results 

The numerical results are given in Table U for g = 16 and 
Table M for q — 64. In each Table the dependencies of oj*, 
p^^'^ and on the code rate R are presented. Note, that £ 
(in each case) is chosen to maximize the functions. For our 
case the maximal values of w*, p^^'^ and were achieved 
for the same £, the value of £ is also given in the Tables. 


VI. Conclusion 

We improved the estimate on the relative decoding radius p 
for the single threshold majority decoder of LDPC codes over 
Fq. The majority decoding algorithm with multiple thresholds 
is suggested. A lower estimate on the decoding radius realized 
by the new algorithm is derived. The estimate is shown to 
be at least 1.21 times better than the estimate for a single 
threshold majority decoder. At the same time analogously the 
result from lH the transition to multiple thresholds does not 
affect the order of complexity. 

All the results are obtained for the case when the constituent 
codes are SPC codes over Fg. The case of more powerful 
constituent codes is considered. It is shown that analogously 
to m the transition to generalized LDPC codes does not lead 
to a gain in the decoding radius. 

To the best knowledge of the authors the obtained estimates 
are currently the best estimates of the decoding radius for low- 
complexity majority decoder of LDPC codes over F^. 
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